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DETAILED ACTION 

This office action is responsive to an AMENDMENT entered 4-23-2009 for the 
patent application 10/734459. 

The Office Action of 1-23-2009 is fully incorporated into this Final Office Action by 
reference. 

Status of Claims 

Claims 1-10, 31-39 are pending. Claims 1, 3, 6 have been amended. Claims 31- 
39 are newly added. 

Claim Objections 

Claim is objected as improper multiple dependent claim. See MPEP § 608.01 (n), 
under the heading "B. Unacceptable Multiple Dependent Claim Wording," and 
subheading "2. Claim Does Not Refer to a Preceding Claim," second example. A proper 
multiple dependent claim depends only from preceding claims. 

In instant case, claim 6 is depend on claim 8, which is not a preceding claim. 

Appropriate correction is required. 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 
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Claims 3, 31 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. 

Claim 3 has been amended to recite "and wherein the credibility rating is based 
on the performance measures of the candidate solution operating on each of the one or 
more training cases not including the particular training case." There is no support for 
such limitation. Applicant did not recite where support can be found in the spec for the 
amended limitation. Applicant should specifically point out the support for any 
amendments made to the disclosure. See MPEP 2163.06 and 714.02. 

Newly added claim 31 is rejected for the same reason. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1-10, 31-39 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Paris et al (Applying Boosting Techniques to Genetic Programming" Jan 2002) 

In general, applicant's inventive concept is combination of evolutionary strategy 
with boosting. Paris teaches such concept and names it GPboost. 
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Claim 1. (Previously Presented) Paris anticipates a processor-based method for 
determining difficulty measures for training cases used in developing a solution to a 
problem, comprising: 

providing a set of training cases (See e.g. Table 5 on learning set. See also 
section 4.3 on learning set) having respectively associated difficulty measures (EN: 
"difficulty measure" not further defined, reads on weight of a sample. See e.g. Table 5 
on weight of an example. See also section 4.3 on Distribution D1 , D2, D3 for each 
samples. See also section 2.2 that badly classified example have a higher weight in the 
next round. As such, higher weight = higher difficulty); 

operating a candidate solution (See e.g. Table 5 on ;V - ) on a particular training 
case (EN: "candidate solution" not further defined, reads on , which is a "function" or 
"hypothesis" of a particular training case). 

determining a performance measure (See e.g. Table 5 on ' '?' ) of the 
candidate solution operating on the particular training case (EN: — M is a measure 
of error between the target output ^ and the output of the candidate solution ); 

determining a credibility rating ("credibility rating" not further defined, reads on 

!> "* £>u V <h i ' ' ) of the candidate solution, the credibility rating 

indicating a degree to which the performance measure is "representative" of the 
difficulty measure of the particular training case (EN: again, "credibility rating" not further 
defined. The Examiner interprets a loss of 0 means the candidate solution is doing 
better job than a loss of 1 , thus more credible); and 
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modifying the difficulty measure of the particular training case based on the 
performance measure of the candidate solution operating on the particular training case 
and the credibility rating of the candidate solution (See e.g. section 4.2. on 

'Upsisife: dMrifsfffciit:: 

..... Ilfclllllllll/ ... . EN: the distribution (i.e. difficulty measure of 
case) of next round is based on the loss (which, in turn, is based on the performance 
measure and the credibility rating of the solution)). 

Claim 2. (Original) The method of claim 1, wherein determining the credibility 
rating comprises: 

selecting one or more training cases from the set of training cases based on the 
difficulty measures of the one or more training cases {EN: merely repeating the process. 
See e.g. section 4.2 on *<»• <• - ); 

determining performance measures of the candidate solution operating on each 
of the one or more training cases (EN: merely repeating the process. See e.g. section 
4.2 on t — i , ?" do ) ;anc j 

computing the credibility rating based on the performance measures of the 
candidate solution operating on each of the one or more training cases (EN: merely 
repeating the process. * w 1 ::: L 1 d<> ). 

Claim 3. (currently amended) The method of claim 2, wherein the one or more 
training cases does not include the particular training case, and wherein the credibility 
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rating is based on the performance measures of the candidate solution operating on 
each of the one or more training cases not including the particular training case (See 
e.g. section 4.1 where it teaches the probability of an example to be picked up is 
proportional to its weight. That means some cases will not be picked, which means the 
credibility rating will not include such particular training cases). 

Claim 4. (Original) The method of claim 1, wherein providing the set of training 
cases having respectively associated difficulty measures comprises initializing a 
difficulty measure of each training case in the set of training cases to a predetermined 

value (See e.g. section 4.2 on [ ). 

Claim 5. (Original) The method of claim 4, wherein the predetermined value is a 

maximum value (See e.g. section 4.2 on M ^ ! ¥\ : 1 » fol dl V . EN: 1/m 

reads on "maximum" value. In particular, 1/m is the normalized "maximum value"). 

Claim 6 (currently amended) The method of claim 8, wherein: 
providing the set of training cases comprises associating each training case in 
the set of training cases with a target output (case label. See e.g. section 4.2 that each 
case has a target classification (i.e. +1 or -1 label). See also section 2.2.); 
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operating the candidate solution on the particular training case comprises 
obtaining an output from the candidate solution operating on the particular training case 

(See e. 9 . section 4.2 on .. I* ' ^ ); and 

determining the performance measure of the candidate solution operating on the 
particular training cases comprises comparing the candidate solution output to a target 
output of the particular training case (determining loss. See e.g. section 4.2 on 

'..••.•utr-HU k«;< tor sad! <-<>;<. mH-- £•< ~ 



Claim 7. (Original) The method of claim 6, wherein comparing the candidate 
solution output to the target output of the particular training case comprises calculating a 
value corresponding to a deviation between the candidate solution output and the target 
output of the particular training case (comparing calculated class with label. See e.g. 
section 4.2. on ttir* **" fer !^™± *' I ^flM ). 



Claim 8. The method of claim 1, wherein modifying the difficulty measure of the 
particular training case comprises modifying the difficulty measure based on a weighted 
average of the performance measure and a previous value of the difficulty measure 
(See e.g. section 4.2 on ^w^^^ l ~r::.> s ~J>: "y 
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Claim 9. The method of claim 8, wherein a weight of the weighted average is 
based on the credibility rating and a base learning rate (See e.g. section 4.2. on 

Claim 10. (Original) The method of claim 1, wherein modifying the difficulty 
measure comprises maintaining the difficulty measure within a predetermined interval 
(See e.g. section 4.2 that the weight of each training example are "maintained" with a 
predetermined interval (for exactly 1 rounds)). 

Claim 31 (New) The method of claim 8, wherein the performance measure of the 
candidate solution operating on the particular training case is computed without 
including training cases in the set other than the particular training case (See e.g. 
section 4.1 where it teaches the probability of an example to be picked up is 
proportional to its weight. That means some cases will not be picked, which means the 
performance measure will not include such particular training cases). 

Claims 32-39 are drawn to a system of claims 1-10, and are rejected for the 
same reason. 

Response to Arguments 

Applicant's arguments filed 4-23-2009 have been fully considered but they are 
not persuasive. 
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In re pg. 6, applicant argues 

* i l vuH ^ >, i t , t i j- x , The 

i Mi. <v v X i. iv. 8»» *, t , - i ^ ( I ! {[ i t 1 

In response, applicant's intend (to appeal) is acknowledged. 
In re pg. 6, applicant argues 

3 ' ' , ' ' >' I -t > f i o , h £ < t ik >> <► iu 1 < 

i I i 1 , vit i . n , i v , i < ^ vj{ , 

mx based cm fee express mmis of the claim nsd£ i.:h\nr, ; should he ccmamicd aceordmf to fhe 

C\|! v es\ « )<} 1 1 II 1 1 J 1 I < t 1 'MUl lulMUvl'u 

In response, the Examiner disagrees. 

1) The Examiner does not see how claim 1 is clearly not anticipated by Paris. 
Such argument is merely a conclusory statement without explaining why and/or how 
Paris fails to teach claim 1 . 

2) The Examiner did not characterize the invention based on language appearing 

in the cited reference. Rather, it is based on an understanding after reading both the 

reference and the specification. It is suggested the applicant re-read [0015] of pgpub 

html version where it states 

"[0015] In accordance with embodiments of the invention, the selection of training cases 
presented to the candidate models is biased toward selecting training cases that are 
more difficult for the candidates of the population to solve. Biasing the selection of the 
training cases takes into account the premise that evolutionary computation produces 
models that become proficient at solving the training cases presented. However, there is 
a distribution for how well a candidate solves the training cases. In other words, a 
candidate model may perform well if presented with some training cases and less well if 
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presented with other training cases. Biasing the selection of the training cases towards 
selection of more difficult training cases enhances the development of solutions that are 
proficient at solving more difficult problems. Candidate solutions that are able to solve the 
more difficult training cases proficiently may be better able to generalize and produce 
more accurate results when presented with a real (non-training) problem." 

It should be clear that applicant's own specification concedes the invention is 
based on the concept of adaboost and evolutionary computation (which includes 
genetic algorithms). 

3) The concept of Adaboost can be found in Paris reference. Further readings 
about Adaboost can be found in "A Short Introduction to Boosting" cited in prior art 
made of record and not relied upon is considered pertinent to applicant's disclosure. 

In re pg. 6, applicant argues 

Ii is clear Jfeas him dots not provkte my teaching »i darned wtmci maUer. 

Claim ! recites > ^ k > a set ' ' » m , v v Msvmg k \\ hj\ < v> ^ i dinkey 

In response, the Examiner disagrees. 

1 ) The Examiner does not see how Paris does not provide any teachings of the 
claimed subject matter. Again, such argument is merely a conclusive statement. 

In re pg. 7, applicant argues 

^ 1 ht , si ^ua 1 - iv rnw so ta %.U k * < n \ i m \ 
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In response, as set forth in the rejection above, the weight of an example is the 
"difficulty measure". 

In re pg. 7, applicant argues 

l l H „ < I fe f 1 fivf" F-OOHs IH > . n t k !l I J iv i K KM! 

In response, as set forth in the rejection above, it is the weight of an example (i.e. 
the value of D(i)) being the "difficulty measure". 

In re pg. 7, applicant argues 

M J foftt i ■> v St V V t < 1 a v i ! ]| I ,1 I k ;:„ 

1 t| !U I ll 1 1 J \p - 1 v< <i ^ < v I. * v. >vf t 1 i I I } t 

dea*ty vt.v- not. jjcovatc assy tcuchmg d' otim element oj'cbim \ . 
In response, the Examiner disagrees. Again, such argument is merely a 
conclusive statement. 

In re pg. 7, applicant argues 

Fk Office su.o arguet fits up&ai u dismb n I wV m < \> vious 

1 >k( t> 1> ! I 11 J t II t ! 1 - 1 ! I i || 

l» i i. v ti . jum ii i ! 1 (Jo . KtMi ^ * lbs 

f>fO-« t . i\n ^ S ]\ ( I 1 t Uli 5>m '' s OV|\ t ,M\k^ h 
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In response, the Examiner disagrees. The updates of distribution are not based 
on parameter B as argued. Rather, it is based on distribution and the lost (which in 
turns depends on the performance measure and credibility ratings as set forth in the 
rejection above). 

In re pg. 7, applicant argues 

"V I t m nuu^ th,u the ^umuof , >. r\ . t ; ,kj t ,w to nim.u-n t. iW run t 

SWos i n . - ,V ] i , t kI» v* 1 i -us K t m. ii - h 

ot ^ n ^ uiu t I k <>l \ \ i i i >{ i i t l < v i 

In response, the Examiner disagrees. As explained above, the updates of 
distribution are not based on parameter B as argued. Rather, it is based on distribution 
and the lost (which in turns depends on the performance measure and credibility ratings 
as set forth in the rejection above). 

In re pg. 7, applicant argues 

i< s ' .1 i 1 . M 1 > I H U t t J J. \ , U 

. Pf - * A* ^:.\ lo „ .J 1 ) v t, 1 1 * I' i '1 L hi ,kv ^ tfcaf 

- £ ft- kMti Nt'KHi \h«J. i tk f < ' 1 ! su , i, i- 

WMCh, MO , it _ I l t>*l k \Ui i > I, f l ! \ i f K * IK f 

v Uir i -vcfiM'.itu n fiv. m\ m Hosu^; i u i- i I m t t t . , sr 5 

IS 4 1 X 1 ^ s \ . 1 1 is I u f U 

In response, the Examiner disagrees. As made clear in the rejection above, the 
"performance measure" is equivalent to the — ^- part of the fitness function. 
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In re pg. 7, applicant argues 

I "> n ^ i t ! its * J > \ < N1 Kt , jj , , w n 

i.r b *i < k ? s <fs^ <> ■< tt T \ s \ 

«. 3 3id;i ■> t t i v n it j>;»ru u "* t ] t u < i t 

In response, the Examiner disagrees. As made clear in the rejection above, the 
"performance measure" is the — ^ of the particular training case. 

In re pg. 7, applicant argues 

ruts 5s u m\mc4 hoed on which is. b^ai or average k>ss oi ;di exan pies < it* m iajj * { 

In response, the Examiner disagrees. As explained above, the updates of 
distribution are not based on parameter B as argued. Rather, it is based on distribution 
and the lost (which in turns depends on the performance measure and credibility ratings 
as set forth in the rejection above). 

In re pg. 7, applicant argues 

s 'K' ! ' U s v U 1 l'i I |>, s oi v «« I 1 , > ti'IKK\ K 1 > <d tt 

i 1 'I i<l \ m t l *> | P \v It P V I illu t U 

!| I ti t i ) t mkuhu i 

In response, the Examiner disagrees. As explained above, the updates of 
distribution are not based on parameter B as argued. Rather, it is based on distribution 
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and the lost (which in turns depends on the performance measure and credibility ratings 
on the particular training case as set forth in the rejection above). 

Examiner Note 

In the event that the applicant is willing to amend, further define "credibility rating" 
to receive favorable consideration. In particular, the Examiner suggests incorporating 
equation [1] in pg. 7 of the spec into claim 1. 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Freund et al "A Short Introduction to Boosting" teaches boosting and adaboost. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See M PEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Lut Wong whose telephone number is (571 ) 270-1 1 23. 
The examiner can normally be reached on M-F 7:30-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vincent David can be reached on (571) 272-3080. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



/Lut Wong/ 

Patent Examiner, AU 2129 
/David R Vincent/ 

Supervisory Patent Examiner, Art Unit 2129 



